﻿Inteligenţă*Ar-ficială* Cursurile*3-4* Proiectul*nostru * Să*învățăm*din*proiecte*trecute* Legarea*en-tăților*în*texte*și*în*afara*lor* Agenți*care*înțeleg*situațiile*din*viața*de*zi*cu*zi* a*unui*partener*uman* Modelarea*unor*manifestări*ale*conș-inței* * * Proiectul*nostru* • Un*socialbot*capabil*să*poate*o*conversație* despre*orice*domeniu* • The*Alexa*Amazon*compe on* – hKps://developer amazon com/alexaprize/ contest-rules** IBM*Watson* • hKps://www youtube com/watch? v=WFR3lOm xhE** • hKps://www youtube com/watch? v=3G2H3DZ8rNc* Asimov*chatbot* • hKps://www chatbots org/chatbot/asimov/* Loebner*compe on** • hKp://www aisb org uk/media/files/ LoebnerPrize2016/Mitsuku pdf** Proiectele*cursului*de*IA* • 2003-2004:*Simularea*unui*joc*de*fotbal* • 2004-2005:*Sistem*de*traducere*automată*–*modelul*de*transfer* • 2005-2007:*PhiSociety*–*societăți*primi-ve*de*agenți*inteligenți*în* compe-ție* • 2007-2008:*Casa*inteligentă* • 2008-2009:*Avatar*uman*vorbitor* • 2009-2010:*Extragere*de*conținut*seman-c*din*texte* • 2010-2012:*Companion- • 2012-2013:*Let's-talk-about-books!- • 2013-2014:(MappingBooks:,Let's,jump,out,of,the,book!, • QuoVadis(–(Chasing(en77es(and(linking(them((a(project(with(the( master(students(in(Computa7onal(Linguis7cs)( • 2014-2015:(MyDailyLife, • 2015-2016:(Modelarea(conș7inței( MappingBooks:( Evade(from(the(book(in(the(real( world!( ( QuoVadis:( Linking(en77es(in(texts* MappingBooks* • A*project*proposal*(submiKed*in*May*2013)*in*the* na-onal*research*projects*contest*(667 388*EUR);* partners:*UAIC-FII,*University*“Ștefan*cel*Mare”* Suceava,*Siveco*–*Bucharest:*approved*with*the* highest*evalua-on*score* • A*term*project*(Oct *2013*–*Jan *2014)*for*3rd*year* CS*students*in*AI* • More*conference*papers* Linguis5cs-Linked-Open-Data*(LLOD)* - Develop*techniques*able*to*decipher(the(seman7c( context(of(texts* - summaries*(general,*par-al,*focused*on*characters),** - narra-ve*lines*(e g *evolu-on*of*sen-ments*between* Vinicius*and*Ligia)* - sta-c*connec-ons*between*en es*(e g *genealogical* trees),** - sta-s-cs*about*en es*(e g *the*dominant*sen-ments* of*Chris-ans*compared*against*those*of*Romans)* 9 Linguis5cs-Linked-Open-Data*(LLOD)* - Genera-on*of*ontologies*from*collec-ons*of* scien-fic*works* - applica-ons*that*“read”*science*books*and*formalise* the*concepts*and*its*instances* - Intelligent*documentary*search* - Personalized*assistants*of*a*research*ac-vity* 10 12 13 I*like*to*read*books*and*to*travel…* Going*out*of*the*book…* I*need*help*to* remember*all* kinship* rela-ons* between* characters* • • • • 17 Characters*in*Forsyte*Saga* The(old(Forsytes( Ann,*the*eldest*of*the*family* Old(Jolyon,*the*patriarch*of*the*family,*having*made*a*fortune*in*tea* James,*a*solicitor,*married*to*Emily,*a*most*tranquil*woman* Swithin,*James's*twin*brother*with*aristocra-c*pretensions;*a*bachelor* Roger,*"the*original*Forsyte"* Julia((Juley),*a*fluKery*dowager;*Mrs *Sep-mus*Small* Hester,*an*old*maid* Nicholas,*the*wealthiest*in*the*family* Timothy,*the*most*cau-ous*man*in*England* Susan,*the*married*sister* The(young(Forsytes( Young(Jolyon,*Old*Jolyon's*ar-s-c*and*free-thinking*son,*married*three*-mes* Soames,*James*and*Emily's*son,*an*intense,*unimagina-ve*and*possessive*solicitor,*married*to*the*unhappy*Irene,*who*later*marries*Young*Jolyon* Winifred,*Soames's*sister,*one*of*the*three*daughters*of*James*and*Emily,*married*to*the*foppish*and*lethargic*Montague(Dar7e* George,*Roger's*son,*a*dyed-in-the-wool*mocker* Francie,*George's*sister*and*Roger's*daughter,*emancipated*from*God* Their(children( June,*Young*Jolyon's*defiant*daughter*from*his*first*marriage;*engaged*to*an*architect,*Philip(Bosinney,*who*becomes*Irene's*lover* Jolly,*Young*Jolyon's*son*from*his*second*marriage;*dies*of*enteric*fever*during*the*Boer*Wars* Holly,*Young*Jolyon's*daughter*from*his*second*marriage,*to*June's*governess* Jon,*Young*Jolyon's*son*from*his*third*marriage,*to*Irene,*Soames's*first*wife* Fleur,*Soames's*daughter*from*his*second*marriage,*to*a*French*Soho*shopgirl*Anne`e;*Jon's*lover;*later*marries*a*baronet,*Michael(Mont* Val,*Winifred*and*Montague's*son;*fights*in*the*Boer*Wars;*marries*his*cousin*Holly* Imogen,*Winifred*and*Montague's*daughter* Others( Parfi`,*Old*Jolyon's*butler* Smither,*Aunts*Ann,*Juley*and*Hester's*housekeeper* Warmson,*James*and*Emily's*butler* Bilson,*Soames's*housemaid* Prosper(Profond,*Winifred's*admirer*and*AnneKe's*lover* 18 MappingBooks* • A*MappedBook-is*a*book*connected*with* loca-ons/events*in*the*virtual*and*real*world* and*sensi-ve*to*the*instantaneous*loca-on*(as* seized*by*the*mobile/tablet)*of*a*reader ** • The*informa-on*made*available*could*possibly* be*different*depending*on*the*moment*and* the*place*of*the*reader ** MappingBooks* • mul dimensional*mash-ups*combining*textual,* geographical*and*temporal*data* • adequate*presenta-on*to*the*reader* • links*sensi-ve*to:** – the*context*of*the*men-ons*in*the*book,** – the*moment*the*user*ini-ates*an*access** – the*current*loca-on*of*the*user* • make*heavy*use*of*en-ty*linking*techniques* • spot*the*book*men-ons*(persons*and*loca-ons)* in*the*real*and*virtual*world** 20 SYNASC, UVT Timișoara, 27 Sept 2016 Aims* 1)*connect*en es'*men-ons*in*the*form*of* nominals*(noun*phrases)*=>*one*coreferen-al* chain*corresponds*to*each*en-ty;** 2)*no*preliminary*records*about*linked*en es*=>* the*knowledge*base*evolves*from*scratch;** 3)*look*specially*for*coreferen-al*(iden-ty*of*en-ty* men-ons)*and*geographical*rela-ons*(posi-on,* distance,*point-of,*near,*intersects,*etc );** 4)*texts*under*inves-ga-on:*Geography*manuals* and*traveling*guides** MappingBooks:*what*is*it*about?* • “Understand”*parts*of*a*text* • Recognise*men-ons*of*persons*and*loca-ons* • Recognise*and*crawl*for*real*world*en es* • Know*where*I*am** • Seize*what*real*world*en es*are*in*my*proximity* • Trace*GoogleMaps*paths,*as*described*in*the*book* • Fetch,*process*and*make*use*of*geo-data* • Mix*images*with*generated*info* • Display*an*aKrac-ve*user*interface* • Client-server* Towards…*live*books* • Mul-dimensional*artefacts*that*combine*textual,* geographical,*temporal,*etc *data* • Evidence*men-ons*of*persons,*loca-ons…* • Links*sensible*at:** – the*context*of*the*men-on*in*book* – the*loca-on*of*the*reader* – the*moment*of*the*lecture** – the*personality*and*preferences*of*the*reader* 24 SYNASC, UVT Timișoara, 27 Sept 2016 Usage*examples* - I* visit* a* city* with* the* traveling* guide* in* my* hand * - places* of* interest,* routes,* are* reordered* depending* on*my*instantaneous*posi-on* 25 SYNASC, UVT Timișoara, 27 Sept 2016 Usage*examples* - I* am* a* school* boy,* in* the* train* going* from* Brașov*to*Sibiu…* - if* I* open* my* tablet* and* head* it* towards* the*le{* side* window* of* the* train,* I* will* see* arrows* showing* the* picks* of* the* Făgăraș* mountains,* exactly* as* in* the* Geography*manual* 26 SYNASC, UVT Timișoara, 27 Sept 2016 Usage*examples* - I*am*in*Paris*for*the*3rd*-me…* - but*only*now*my*MB*Lonely*Planet*guide*signals*me* this*temporary*exhibi-on*opened*in*the*Pyramid* 27 SYNASC, UVT Timișoara, 27 Sept 2016 MappingBooks*is*addressed*to…* • Youngsters,*school*people*–*could*we*bring*back*the*book* in*their*hands? * • Teenagers,*adventurers,*travelers,*lovers*of*excursions*–* socialize*about*places*men-oned*in*guides* • Pensioners*–*socialize*about*common*readings,*cultural* preferences* • Researchers*in*Language*Technology*&*Computa-on* Linguis-cs*–*access*to*annotated*linguis-c*resources** • Owners*of*textual*data*(edi-ng*houses,*media*companies,* tabloids)*–*sell*beKer*their*products* • Local*administra-on,*tourist*agencies*–*ad*on*places*of* local*touris-c*interest** 28 SYNASC, UVT Timișoara, 27 Sept 2016 The*applica-on* 1)*Connects*men-ons*of*en es*(nominal*groups)* =>*one*en-ty*=*a*chain*of*coreferen-al*men-ons** 2)*The*knowledge*base*does*not*include*any*apriory* records*about*en es*=>*starts*from*scratch* 3)*Iden-fies*geographical*rela-ons*(distances,* posi-ons,*proximi-es,*intersec-ons,*etc )* 4)*Texts,*for*the*-me*being:*geography*manuals* 29 SYNASC, UVT Timișoara, 27 Sept 2016 Instantaneous*contexts** (vola-le*data*collected*during*daily*or* sporadic*use,*quickly*changing)* • informa-on*seized*by*sensors*or*inferred:* – the*place*where*you*are*now,*recent*travels,*the* history*of*past*travels* • informa-on*accumulated*on*the*server:* – the*book*that*you*read*now,*recent*readings,*the* history*of*your*readings* • informa-on*inpuKed*by*the*user:** – inten-on*to*start*a*journey** 31 ICCCI-RUMOUR, Halkidiki, 28 Sept 2016 Vola-le*profiling* • Contextual*informa-on* ⇒ *Make*up*specific*vola-le*“signatures”*of* users*as*aKribute-value*vectors* Mixed*profile* • Sum*up*the*two*types*of*data*used*in*profiling* 32 ICCCI-RUMOUR, Halkidiki, 28 Sept 2016 Accessibility*of*personal*data* • In*accord*with*the*trendy*typology*of* accessibility*of*data*adopted*by*current*social* media*networks:** – public** – restricted*to*classes*of*friends** – for*personal*use*only** 33 ICCCI-RUMOUR, Halkidiki, 28 Sept 2016 Matching* • Apply*scored*vector*matching*techniques* against*other*users'*signatures* • Retain*the*best*ranked*matches* 34 ICCCI-RUMOUR, Halkidiki, 28 Sept 2016 Networking*Readers:* enhance*e-Books*reading*experience* • Use*seman-c*and*geographical*links*to*form* communi-es* – *if*books*“subscripted*for”*declared*visible*=>* • current(co-readers(of(B* • co-readers(of(B* – *if*“instantaneous*or*past*loca-on”*declared*visible*=>* • current(co-proximity(of(L** • co-proximity(of(L* • current(co-track(of(T(( • co-track(of(T(* – any*combina-ons* 35 ICCCI-RUMOUR, Halkidiki, 28 Sept 2016 Networking*Readers:* enhance*e-Books*reading*experience* • Easy*to*imagine*other*ways*to*form*communi-es* rooted*in*lectures* – intersect*common(readings*and*a`ended(places*with* levels(of(friendship*reported*by*other*social*media,*like* Facebook(or(Twi`er** – real-world(events*and*en77es(men7oned*in*a*book* associated*with*real-world(loca7ons*and*par-cular* moments(of(the(year/day* 36 ICCCI-RUMOUR, Halkidiki, 28 Sept 2016 NER = Name Entity Recognition EC = Entity Crowling RD = Relations Detection GEO = Geography M&T = Maps and Trajectories AR = Augmented Reality DEV = Device Info INT = Interfaces RES = Resources M&E = Management and Evaluation 37 SYNASC, UVT Timișoara, 27 Sept 2016 MappingBooks:*acknowledgements* • Undergraduate*students*from*the*Faculty*of*Computer* Science*in*Iași,*who*in*the*first*term*of*the*university*year** 2013-2014*have*build*the*MB*prototype*as*a*term*project*in* the*AI*course ** • Romanian*Ministry*of*Educa-on*and*Research*for*the*grant* PN-II-PT-PCCA-2013-4-1878*Partnership*PCCA*2013* “MappingBooks*-*Intră*în*carte!”,*July*2014*–*December*2017* • Mihai*Niculiță*(Fac *Geography)*in*UAIC*–*for*rendering*the* maps*in*MB* • Vivi*Năstase*for*relevant*ideas*and*realisa-on*of*two*figures* • The*other*two*partner*ins-tu-ons:*SIVECO*–*Bucharest*and* “Ștefan*cel*Mare”*University*of*Suceava* 38 ICCCI-RUMOUR, Halkidiki, 28 Sept 2016 QuoVadis:( Chasing(en77es(and(links(in( books( 39 SYNASC, UVT Timișoara, 27 Sept 2016 The ‘QuoVadis' corpus hKps://nlptools info uaic ro* 40 SYNASC, UVT Timișoara, 27 Sept 2016 A*corpus*seman-c*en es*and* rela-ons* • Type*of*en es:* – persons* – gods* – groups*of*persons*and*gods* – body*parts*** • Reman-c* rela-ons* among* en es* of* these* types* 41 SYNASC, UVT Timișoara, 27 Sept 2016 Entities* • individuals (Marcus Vinicius, Lygia), groups (the Christians, the soldiers) and classes (the emperor); • syntactic realisation: NPs (determiners – a soldier, adjectives – young patrician, complement PPs included – the son of one consul ; but no relative clauses; • included entities for Romanian language: [te] [iubesc; REALISATION=INCLUDED] , Marcus vs 12 [I] love [thee] , Marcus 21 • recursive referential expressions: [the adherents [of Christ] ] are praying… 21 42 Relations* • Anaphoric relations: co-referential; • Non-anaphoric relations: – kinship; – affective; – social 43 SYNASC, UVT Timișoara, 27 Sept 2016 Anaphoric relations* • coref • coref-interpret • member-of, has-as-member (inverse) • isa, class-of (inverse) • part-of, has-as-part (inverse) • subgroup-of, has-as-subgroup (inverse) • has-name, name-of (inverse) Example:** [Lygia] was unable to answer, for weeping seized [her] anew Acte gathered 12 [the maiden] to her bosom, and strove to calm [her] excitement 34 coref ; coref-interpret ; coref 44 SYNASC, UVT Timișoara, 27 Sept 2016 Kinship relations* • parent-of • child-of (inverse of parent-of) • grandparent-of and grandchild-of (inverse) • sibling (symmetrical) • ant-uncle-of, nephew-of (inverse relation) • cousin-of (symmetrical) • spouse-of (symmetrical) • unknown Example:** "Pardon me, Lygia For me thou art [ [of a king] ] and [ [of Plautius] ] “ 43 child-of ; child-of 45 SYNASC, UVT Timișoara, 27 Sept 2016 Social relations* • superior-of • inferior-of • in cooperation-with • colleague-of • in competition-with • opposite-to Example:** [Petronius] …but to [his] misfortune [he] 1 2 3 [Cæsar himself] , hence [he] roused [his] jealousy 4 5 6 in competition-with ; coref ; coref ; coref 46 SYNASC, UVT Timișoara, 27 Sept 2016 Affective relations* • love • loved-by • hate • hated by • upset • friendship • worship Example:** Vinicius entered Lygia's dungeon and remained there till daylight…Both changed by degrees into sad souls with [ each ] [ other ] 12 rec-love 47 SYNASC, UVT Timișoara, 27 Sept 2016 A complex example cui i-ar fi putut trece prin minte că [un patrician] , [nepot şi 1 [fiu de [consuli] ] ] , ar putea să se găsească printre gropari 432 Besides, into whose head could it enter that [a patrician] , [the 1 grandson [of one consul] ] , [the son [of another] ] , could be 5 2 7 6 found among servants, corpse-bearers RO: coref , kinship:grandchild-of ; kinship:child-of ; EN: coref , coref , kinship:grandchild-of , kinship:child-of 48 SYNASC, UVT Timișoara, 27 Sept 2016 General*sta-s-cs*over*the*corpus* • 7,281*sentences* • 146,822*tokens,*punctua-on*included* • 171,029*tokens*summed*up*under*all*rela-ons* • 24,636*en-ty*men-ons* • 22,301*referen-al*rela-ons* • 755*AKS*rela-ons*(Affec-ve*+*Kinship*+*Social)* • 752*triggers* 64 SYNASC, UVT Timișoara, 27 Sept 2016 Example:*affec-ve*rela-ons*love*and*worship* 65 SYNASC, UVT Timișoara, 27 Sept 2016 Example:*affec-ve*rela-ons*fear-of*and*hate* 66 SYNASC, UVT Timișoara, 27 Sept 2016 Vinicius'*links*with*other*characters* 67 SYNASC, UVT Timișoara, 27 Sept 2016 Seman-c*rela-ons*involving*Vinicius* 68 SYNASC, UVT Timișoara, 27 Sept 2016 69 * * Marcus * * Vinicius * * era * * * * ** fiul * ** * *** * **** surorii * **** * ***** sale * **** * **** mai * **** mari * *** * ** * * * * , * * * * ** care * * * * , * * cu * * ani * * în*urmă * * , * * se * * căsătorise * * cu * * * ** * *** tatăl * **** * ***** acestuia * **** * *** * * * * * * * ** consul * ** pe * ** vremea * ** lui * ** * *** Tiberiu * ** * * * * * ** * * * ** QuoVadis:*thanks* • Students*in*Master*of*Computa-onal* Linguis-cs,*series*2012-2014*–*annota-on* • Anca*Bibiri,*Cătălina*Mărănduc,*Daniela*Gîfu*–* coordina-on,*valida-on* • Paul*Diac,*Andrei*Scutelnicu,*Mihaela*Colhon*–* programming** 70 SYNASC, UVT Timișoara, 27 Sept 2016 Proiectul*IA*al*seriei*2014-2015* MyDailyLife( • Un*agent*capabil*să*“înțeleagă”*situațiile*în* care*se*află*Masterul*său,*să*le*transpună*în* text*și*să*conducă*un*dialog*rela-v*la*ele* Proiectul*IA*al*seriei*2014-2015* MyDailyLife( Un*agent*capabil*să*“înțeleagă”*situațiile*în* care*se*află*Masterul*său,*să*le*transpună*în* text*și*să*conducă*un*dialog*rela-v*la*ele* Ce*trebuie*să*facă*sistemul?** • Să*“ș-e”,*în*cât*mai*multe*momente*ale*zilei:* – ce*fac** – unde*mă*aflu* – cu*cine*mă*întâlnesc* – despre*ce*vorbesc* – de*ce*fac*anumite*lucruri* • Să*fie*capabil*să*formeze*fraze*care*exprimă*ce*am* făcut* • Să*fie*capabil*să*poarte*un*dialog* – despre*ziua*de*azi,*cea*de*ieri** – cea*de*mâine*(?)* Cui*se*adresează?* Persoanelor*în*pericol*de*boli*degenera-ve*ale* creierului*(Alzheimer*etc ) * Module** 1 LOCALISATION 2 MOVEMENT 3 FACES 4 SOUNDS&VOICES 5 INFERENCES 6 BEHAVIOUR 7 TEXT GENERATION 8 QUESTION-ANSWERING 9 INTERFACES 10 CLIENT-SERVER 11 STANDARDS AND EVALUATION System*descrip-on- • A(client-server(architecture( • 3(types(of(modules:(( • interpre7ng(primary(data(from(my(mobile( • doing(inferences(and(learning(my(behaviour( • genera7ng(text(and(engaging(dialogs(* day-7me(sensing( evening(ac7vi7es( Exemplu* • TIME=7:30,*PROXIMITY*=*bedroom,*CLOCK*=* awake -me,*SOUND*=*awake ringing,* GG:LIGHT*=*intensity raise,*WiFi WAVE*=* movement,*ACCELERATION*=*zero,*GPS*=*null,* GEO POSITION*=* home(remember last posi-on)* • MyDailyLife*output:*Astă*dimineață*am*fost* trezit*de*alarmă*la*ora*7:30*în*dormitorul*meu ** 2015-2016:*Modelarea*unor* manifestări*ale*conș-inței* • Intrări(–(3(7puri(de(canale:(* – textual*(un*text)** – acus-c*(inregistrări*vocale)* – vizuale*(imagini)* • Ieșire:(reacții((emoții)(similar(celor(umane( ( Producerea*materialelor*de*învățare* • Prin(explicitarea,(pe(eșan7oanele(alese,(a:* – emoțiilor** – dorințelor* – gândurilor** pe(pare(le(manifestați(voi(inșivă(la*ci-rea/ascultarea/ vederea*intrărilor *** • Veți*căuta*apoi*seturi*de*intrări*similare*(care*vă* produc*reacții*similare)*formând*as…el*seturi*de* antrenament * • Notați*manifestările*voastre*emo-ve*pe*intrările* alese*într-un*standard*(XML),*pe*care*trebuie*să-l* propuneți * A-tudinea*față*de*personaje* • Ați*ci-t*deja*romanul*“Quo*Vadis”…* • Ați*notat*pe*manșeta*foilor*de*hâr-e* (ecranului)*sen-mentele*pe*care*le*încercați* față*de*diverse*personaje*în*diferite*momente* din*derularea*acțiunii* • Inventați*un*stardard*(XML)*de*notare*a* a-tudinii*voastre*față*de*personaje*în*funcție* de*evoluția*evenimentelor:*a-tudinile*lor,* acțiunile*lor,*gândurile*lor*